Peierls-like transition induced by frustration in a two-dimensional antiferromagnet 
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We show that the introduction of frustration into the spin-1/2 two-dimensional (2D) antiferromag- 
netic Heisenberg model on a square lattice via a next-nearest neighbor exchange interaction can 
lead to a Peierls-like transition, from a tetragonal to an orthorhombic phase, when the spins are 
coupled to adiabatic phonons. The two different orthorhombic ground states define an Ising order 
parameter, which is expected to lead to a finite temperature transition. Implications for L^VOSiCU, 
the first realization of that model, will be discussed. 
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Peierls transition [Q is well documented for quasi-one 
dimensional systems when the coupling to the lattice is 
taken into account, both for metals and for magnetic in- 
sulators. |2| It corresponds to a breaking of the trans- 
lational symmetry, with a dimerization and a doubling 
of the unit cell in the case of spin chains. In strictly 
one-dimensional systems, the transition occurs for an in- 
finitesimal coupling of the lattice because the gain of elec- 
tronic or magnetic energy always overcomes the loss in 
elastic energy. For instance, for S=l/2 chains, the gain 
in the magnetic energy by making a lattice distortion 8 
is AE mag ~ <5 4 / 3 , whereas the loss due to elastic energy 
is AE e i as tic ~ S 2 , and therefore a small but finite lattice 
displacement is always stabilized in the thermodynamic 
limit. ]3| This result is very specific to one-dimension 
though, and in higher dimensions structural transitions 
are not expected for generic spin models unless other de- 
grees of freedom play a role, like orbital degeneracy in 
the cooperative Jahn- Teller effect. [Q 

In this Letter, we present strong evidence that, when 
frustration is present, 2D systems can behave in a very 
similar way, i.e., they can undergo a lattice instabil- 
ity that breaks the symmetry even for very small spin- 
lattice coupling. Motivated by recent results obtained 
on Li 2 VOSi04 |||| (see the discussion below), we con- 
centrate on the so-called J\ — Ji model on a square lat- 
tice, where J\ and J 2 stand for nearest and next-nearest 
neighbor antifcrromagnetic exchange integrals. In this 
model, by increasing the frustration, there is a phase 
transition from Neel order to a spin-liquid phase for 
J2/J1 ~ 0.38. The nature of the disordered phase is 
still under debate, and many different possibilities have 
been proposed. |8|-pT|] By increasing further the frustra- 
tion (J2/J1 0.55), the ordering by disorder mecha- 
nism |l2j is expected to stabilize a collinear order, with 
spins ferromagnetically aligned either along the x or the 
y axis and antiferromagnctically aligned along the other, 
corresponding to pitch vectors Q = (0, n) and Q = (n, 0), 
respectively. In the pure spin model, Chandra and collab- 
orators |l3| argued that this residual two-fold degeneracy 
of the ground state (GS) generates a finite-temperature, 
Ising-like phase transition. 



However, like in the Jahn- Teller effect, where the or- 
bital degeneracy is lifted by the electron-vibron interac- 
tion, this degeneracy might a priori also be lifted by a 
structural distortion if the system is coupled to the lat- 
tice. As we shall see, this is indeed the case, and ferro- 
magnetic and antiferromagnetic bonds acquire different 
lengths. In that case, it is not the translational sym- 
metry that is broken, like in the standard Pcicrls tran- 
sition, but the rotational symmetry. Still the analogy is 
very suggestive: Here, the equivalent of the two dimer- 
ized structures of the chain are two orthorhombic phases 
with the longer bond along the x and y directions re- 
spectively, and we will talk about a Peierls-like transi- 
tion. Note that this mechanism is significantly different 
from the one generated by thermal fluctuations |d|: In 
particular, a structural distortion will have specific con- 
sequences for NMR, which might have already been ob- 
served in Li 2 VOSi0 4 . § 

The J1—J2 model coupled to adiabatic phonons is de- 
fined by the Hamiltonian: 



(1) 



where Sj = (Sf , Sf , Sf) is the spin-1/2 operator at site 
i, Sri is the displacement of atom i, assumed to be in 
the plane, and dij is the distance between atoms i and j. 
This model depends on the following parameters: i) The 
bare values of the positions of the atoms R°, which form 
a square lattice; ii) The bare values of the exchange inte- 
grals Ji and J2 , corresponding to the values of J\ (d) and 
J2 (d) for the bare values of the distances dP^ = ||R?— R°||; 
Hi) The elastic coupling constants K\ and K.2- Since 
these coupling constants are effective parameters - a de- 
tailed description of the lattice dynamics would involve 
elastic terms between transition metal atoms and ligands 
- we have chosen the form of Eq. (|l]) , but the results are 
essentially the same with and elastic term proportional 
to (d^ — d®j) 2 /(d®j) 2 ; iv) The spin-lattice coupling con- 
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stants a\ and a 2 : In transition metal compounds, super- 
exchange theory combined with empirical dependences 
of hopping integrals on distance O] leads to exchange 
integrals that vary like the inverse of the distance to a 
certain power a, with a in the range 6—14, and for small 
displacements we can write: 



with Sdij = dij 




JxtU-aw^Lj, (2) 



^(RO-Rp-O^-^O/dO. No- 
tice that the Hamiltonian is invariant under the rescaling 
«i,2 — * Aai,2, K12 — > \ 2 Ki^2 and Sri — > 8vi/\. This al- 
lows one to fix one parameter among a±, ct2, K\ and 
1^2 • The physical values of the magnetic couplings are 
unaffected by this transformation. 
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FIG. 1. Structural phase diagram for the 4x4 cluster for 
a.2 = <xi and K2 = 0. Points indicate the critical values for 
which the transition occurs and lines are guides to the eye. 
Stars indicate the points with a vanishing magnetization in 
the linear spin-wave approximation, by using the optimized 
exchange integrals. In each region a sketch of the lattice is 
depicted. Inset: Comparison between the 4x4 (full circles and 
dashed lines) and the 8-site cluster (empty circles and solid 
lines). Notice that for the 8-site cluster the DL phase abruptly 
disappears for J2/J1 > 0.25, and that, for J2/J1 = 0.5, the 
OL is stabilized for an infinitesimal spin-phonon coupling. 

Since we are concerned with the zero-temperature 
properties of a 2D system, this problem can in princi- 
ple be attacked within the linear spin-wave (LSW) ap- 
proximation. However, to perform an unbiased calcula- 
tion requires to treat random configurations of the bond 
lengths, and LSW is essentially impossible to implement 
in that case since the first step, the determination of the 
classical GS, has no analytic solution. So we have de- 
cided to start with exact diagonalization of finite clusters, 
which allows an unbiased determination of the optimal 
configuration, and then to use LSW in the phases where 
it can provide useful insight. 



To find the optimal configuration of the bond lengths 
for a given value of the coupling parameters 0.2 , K\ 
and K 2 ) in the subspace of S^ ot — 0, we start from a 
random configuration of the site displacements and we 
iteratively improve the total energy by changing the lat- 
tice parameters Sdij. For clarity, the exchange coupling 
constants at equilibrium will be denoted with tilde, e.g. 
Ji and J 2 , with possibly more than two of them as we 
shall see. This self-consistent Lanczos (SCL) technique 
has been successfully used for different ID and quasi- 
1D models. [[l5| By working with the relative distances 
Ay = Sri — Srj, we are able to describe all kinds of struc- 
tural displacements, including expansion and contraction 
of the lattice. 

Since for a random configuration all symmetries are 
lost, one is limited to rather small clusters. We have per- 
formed systematic calculations for the 45° degree tilted 8- 
site cluster and for the 4x4 cluster, and we have checked 
a number of conclusions on the 32-site cluster. It turns 
out that the 8-site cluster is pathological for J 2 / J\ > 0.5, 
the nearest neighbor spin-spin correlations being exactly 
zero. This peculiarity introduces a very strong depen- 
dence on the actual values of the spin-phonon coupling, 
which is definitely an artifact of this lattice size. In this 
regard, since for the 4x4 cluster the short-range corre- 
lations are finite for all finite values of J2/J1, this cluster 
is expected to give more reliable insight into the actual 
lattice deformations. 

In Fig. |l|, we show the phase diagram obtained with the 
SCL method for the 4x4 cluster in the case of a 2 = a ii 
K\/J\ — 10, and K 2 = 0. This choice of K 2 = was 
physically motivated by the fact that elastic constants 
usually decrease very fast with distance. However we 
have also determined the phase diagram for K%j J\ = 10. 
A detailed account of the dependence of the results on the 
precise value of K2 and 0:2 will be given elsewhere, Ej ] 
but the general conclusion is that modifications are not 
qualitative but only quantitative, and quite small. Be- 
sides, thanks to the invariance of the Hamiltonian on the 
rescaling mentioned above, the phase diagram is actually 
the same for any ratio K\j ' J\ up to a rescaling of ol\. So, 
although there are a lot of parameters in the model, the 
results discussed below are generic. 

Among all the possible lattice deformations, only three 
are stable, depending on the values of the parameters: 
i) the tetragonal lattice (TL), with all the bond length 
equal, with only one value of J\ and J 2 . The TL preserves 
all the translational and rotational symmetries, and the 
effect of the spin-phonon coupling is only to rcnormalizc 
the bond length: the GS on any finite lattice system is 
unique, it) the orthorhombic lattice (OL), with two dif- 
ferent bond lengths in the x and y directions, inducing 
two different n.n. exchange integrals Jf and J\, but only 
one n.n.n. exchange integral J 2 . This phase breaks the 
7r/2 rotational symmetry and therefore the GS is two- fold 
degenerate. Hi) the dimerized lattice (DL), with three 
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different bond lengths, breaking the translational sym- 
metry of one lattice spacing in one direction, leading to 
two n.n. exchange integrals in one direction, e.g., Jf 
and Jf , one in the other, Jf , and two different n.n.n. 
exchange integrals J2 and J' 2 . The DL breaks both the 
7r/2-rotation and the translational symmetry along one 
axis, and the GS is four- fold degenerate. In Fig. 0, we 
show the behavior of the equilibrium exchange integrals 
for three different ratios of J2/ Jx- 
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FIG. 2. Equilibrium exchange integrals Ji (left panels) 
and J2 (right panels) as a function of the spin-phonon cou- 
pling for three different values of the ratio J2/J1 of the bare 
exchange integrals. The parameters are those of Fig. [j]. 

The comparison between the 8-site and the 4x4 lat- 
tice for J2/J1 < 0.5 shows that the phase-boundaries are 
comparable, and that both the OL and the DL regions 
expand from 8 to 16 sites. This gives some confidence 
that these phases exist in the thermodynamic limit. As 
we shall see, this is confirmed for the OL by LSW. The 
fate of the dimerized phase upon increasing the system 
size is difficult to assess. If the J1 — J2 model without 
phonons has a magnetically dimerized GS in the gapped 
phase (0.38 < J2/J1 ^ 0.55) as several authors have 
suggested, HH one would expect this phase to expand 
down to zero spin-phonon coupling around J2/J1 = 0.5. 
The results for 8 and 16 sites do not give any indica- 
tion of such a behavior, and larger system sizes would be 
necessary to reach a definite conclusion. Unfortunately, 
because of the huge amount of time needed to diagonal- 
ize larger clusters with free bond lengths, it is impossible 
at present to perform a systematic size scaling within the 
SCL approach. 

To get further insight into the transition between TL 
and OL, we consider a similar self-consistent approach 
based on the spin-wave (SCSW) approximation of the 
Hamiltonian Eq. (|l|). This approximation, based on 
the assumption of an underlying ordered phase, is not 
suitable to study the DL, which is expected to be a 



gapped phase. Within the SCSW approximation, we 
allow the lattice to vary the bond lengths indepen- 
dently along the two spatial directions, but preserv- 
ing all the translational symmetries, which only allows 
to describe OL and TL: Jf' y (5) = Ji(l + axS XjV ) and 
J2{5) — J2[l + Oi\{§ x + S y )/2] (here we only consider 
the case of a 2 — ol\ for simplicity). The first step is to 
find the classical state. The two local minima are the 
Neel and the collinear state (whereas incommensurate 
phases are not stabilized), with energies per site given by 
= ~[Jf (S)+J?(5)]/i+ J 2 (5)/2+Kx(5 2 x + 5*)/2 and 
e c cl {8) = [±Jf{5) T J\ (S)]/4 ~ J*(S)/2 + Kx(6 2 x + S*)/2, 
respectively. In both cases the magnetic gain is pro- 
portional to the lattice distortion. The stable config- 
uration is obtained by minimizing with respect to 5 X 
and by. For the collinear state we find that the min- 
imal configuration is obtained for 5 X different from 6 y , 
S x = ax(J 2 T Jx)/{AK X ) and S y = ai(J 2 ± Ji)/(4ifi), and 
its energy per site is = —J 2 /2 — ol\{J\ + Jf)/(16ifi). 
On the contrary, for the Neel state the configuration 
with S x — S y — ax{J\ — J 2 )/(AKx) is stabilized, with 
= -{Jx - J 2 )/2 - a\{Jx - J 2 ) 2 /(16Xi). Therefore, 
the transition from the Neel to the collinear state oc- 
curs for J 2 = Jx/[2 + a\Jx/{^Kx)]. As a consequence, 
for J%j Jx > 0.5 an infinitesimal coupling with the lat- 
tice stabilizes the collinear phase, inducing a structural 
transition to an orthorhombic phase. On the contrary, 
for J2/J1 < 0.5, a finite ax is needed to obtain the or- 
thorhombic phase. The fact that the transition line bends 
towards smaller values of J 2 /Jx (see Fig. ||) is just a con- 
sequence of the fact that J2/J1 > J2I J\- 

The presence of the structural transitions are preserved 
upon introducing quantum fluctuations at the LSW level, 
although the equilibrium distances are slightly changed 
from the the ones found in the classical limit. The only 
qualitative difference is that quantum fluctuations may 
destroy the magnetization near the classical transition, 
leading to a spin-liquid state: The boundaries of this 
gapped phase are obtained by calculating the magneti- 
zation within LSW approximation for the equilibrium 
exchange integrals. Rather interestingly, by increasing 
the spin-phonon coupling, the disordered region shrinks, 
eventually leaving the possibility of a direct transition 
between Neel and collinear phases. The results of the 
SCSW calculation are shown in Fig. |j| 

Outside the spin-liquid region, there is a good quan- 
titative agreement between the SCL and the SCSW cal- 
culations in describing the TL to OL transition for small 
to intermediate frustration, whereas there is a difference 
for large frustration, i.e., J-z/Jx it 0.5. Indeed, within 
the SCL method on the 4x4 cluster, the TL structure 
is always stable for small spin-phonon coupling, and this 
is probably an artifact of the small cluster considered. 
By contrast, within the SCSW method, in the collinear 
phase, the lattice is unstable toward an orthorhombic de- 
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formation for an infinitesimal spin-phonon coupling. This 
is expected to be definitely the real situation, because of 
the collinear spin arrangement, where the different mag- 
netic correlations along the x and y directions naturally 
induces an instability in the underlying lattice structure. 




FIG. 3. Energy vs lattice distortion S within the SCSW 
approximation for K\j J\ = 10, K2 = 0, cti = 0.1, 
J2/J1 = 0.2 (a) and J2/J1 = 0.6 (b): The case of 6 X = S v = 6 
(continuous lines) and 5 X = 0, S y = 5 (dashed lines) are 
shown, (c): Phase diagram within the SCSW approxima- 
tion for K1/J1 — 10. Stars indicate the points where the 
magnetization vanishes and lines are guides to the eye. The 
dashed line indicates the classical transition between the Neel 
state and the collinear state. In each region a sketch of the 
lattice is depicted. 

From an experimental point of view, the first prototype 
of the spin-1/2 2D J1—J2 model has been recently syn- 
thetized. |§ It is a layered vanadium oxide Li2VOSi04 in 
which VO5 pyramids are arranged in such a way that sec- 
ond vanadium neighbors are in the same plane while first 
neighbors are not, so that J2 need not be smaller than 
J\, There is no general agreement on the precise value 
of the ratio J2/J1, but both experimental and theoreti- 
cal estimates lead to a ratio significantly larger than 1/2: 
NMR, muon spin rotation, magnetization and specific- 
heat measurements || suggest that J 2 / J\ — 1.1 with 
J 1 + J 2 — 8K, while and LDA calculation by Rosner et 
al. |o| found that J2/J1 is of the order 10. In any case, 
the system is expected to develop collinear order, which 
has been confirmed by NMR results at the Li site. Inter- 
estingly enough, the 29 Si NMR spectrum is very anoma- 
lous at low temperature, J(| and given the very symmetric 
position of Si in the lattice, this cannot be attributed to 
the development of collinear order but must be related to 
a structural phase transition. Given the rather low char- 
acteristic temperatures in that system (T c ~ 2.8K while 
the transfer of weight of the Si line is complete at 2 K) , a 
precise structural determination of the low temperature 



phase has not been possible yet. On the basis of the re- 
sults of the present work, we would like to propose that 
this is related to the natural instability of the collinear 
phase toward an orthorhombic distortion that we have 
identified in the J1 — J2 model coupled to the lattice. 

In summary, we have shown that frustration can lead 
to a Peierls-like transition when the coupling to the 
lattice is taken into account. This has been proven 
for the J1—J2 model, which is expected to have a 
zero-temperature spontaneous instability towards an or- 
thorhombic phase for infinitesimal spin-lattice coupling 
when the collinear order take place. This effect, which 
is related to the presence of a residual degeneracy of the 
GS after quantum fluctuations have been taken into ac- 
count, is expected to be efficient in other quantum frus- 
trated antiferromagnets, and work is in progress along 
these lines. For the J1—J2 model, another surprise came 
from the parameter range in which a dimerized phase is 
stabilized. This phase seems to be limited to large values 
of the spin-lattice constant, while it is also expected to 
occur for infinitesimal coupling if dimer order is present 
in the gapped phase around J%j J\ — 0.5. It would be 
very exciting to have a physical realization of the J\—J% 
model in that parameter range to have an experimental 
input regarding the relevance of that phase. 
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